TITLE OF THE INVENTION 

CUBIC CONVOLUTION INTERPOLATING APPARATUS 
AND METHOD THEREOF 

CROSS REFERENCE TO RELATED APPLICATIONS 

This application claims the benefit of Korean Patent Application No. 00-48906 filed 
on August 23, 2000, the disclosure of which is incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to cubic convolution interpolation, and more 
particularly, to a cubic convolution interpolating apparatus which can minimize information 
loss due to a change in the resolution of an image signal, and a method thereof. 

2. Description of the Related Art 

Cubic convolution interpolation, which is one of various techniques of scaling or 
resampling original image data, has been proposed for compensating for a disadvantage 
encountered by conventional interpolation techniques in which a sin c(x) function is used. 
The interpolation technique using sin c(x) has been proposed for attaining more ideal 

interpolation, when an interpolated continuous function y^ x ) f° r original image sample 
data r ( x is given by: 

/ \ X k) 

f(x)=2lc k fi(x-x k ) 

k 

which can then be rewritten, using a function of sin c(x), as: 

/(*)=£ /(** ) sin c ( x - x k ) 

k 

wherein P(x) is a basis kernel function, c k is a coefficient concerning the image data of an 
arbitrary pixel, that is, f(x k ), x is an interpolation point of an arbitrary pixel, and x k denotes 
sample points of original image data. 
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However, since the sin c(x) function is defined in an infinite region, a vast quantity 
of data must be calculated, which makes actual implementation impossible. Thus, a 
function that can be used in lieu of the sin c(x) function has been developed by many 
researchers, and the cubic convolution interpolation is one of the representative 
interpolation techniques using the newly developed function. 

The cubic convolution interpolation uses in lieu of sin c(x) a basis kernel function 
P(x) having an effective value in the region of (-2, 2), as represented by: 

[(a + 2)|x| 3 -(a + 3)W 2 + l 0<|jc|<ll "* (3) 
^ \a\xf-5a\xf + M\x\-Aa \<\x\<2) 

In other words, when s = x-x k and 1— s = x k+1 - x in the relationship between an 
interpolation point x and an ambient sampling point s, 0 < s <1 and x k <, x < x k+1 , by using 
the basis kernel function p(x) in lieu of sin c(x), a cubic convolution interpolated 
continuous function can be obtained, as represented by: 



f(x)=f(x k _ ^{a(s 3 - 2s 2 + *)} - (4) 
+ f(x^[a(s 3 - s 2 )+(2s 3 - 3s 2 + 1)} 

+ f ( x k + M ai ~ s3 + 2 * 2 " 5) + ( ' 2s3 + 3iy2) } 

+ f(x k+ 2 ) { ai - s3 + s2>> ) 
wherein _ 2s 2 + s)} > {a (s 3 - s 2 ) + (2s 3 - 3s 2 + 1)} > 

{a(-^ 3 + 2s 2 - + {~2s 3 + 3s 2 )} and {a(-s 3 + s 2 )} are interpolation coefficients, 

a is a parameter for varying the characteristic and shape of a basis kernel and determining 
the interpolation coefficient. 

Riftnan et al., (S.S. Rifman, Digital Rectification of ERTS Multispectral Imagery in 
Proc. Symp. Significant Results Obtained from ERTS- 1 (NASA SP-327), I, Sec. B, pp. 
1131-1142, 1973) discloses an interpolation technique in which interpolation is performed 
by obtaining a cubic convolution interpolated continuous function such that a is set to - 1 
and the slopes of p(x) and sin c(x) coincide at a point where x = 1 . Keys et al. (R.G. Keys, 
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Cubic Convolution Interpolation for Digital Image Processing IEEE transactions on 
Acoustic Speech Signal Processing, Vol. 29, pp. 1153-1 160, 1981) proposes an 
interpolation technique in which a is set to - 1/2 and then a cubic convolution interpolated 
continuous function is obtained. However, according to these techniques, since a is a fixed 
value, a careful consideration cannot be taken into account for a variety of frequency 
characteristics of an image. 

To overcome the drawback, Park et aL (S.K. Park and R.A. Schowengerdt, Image 
Reconstruction by Parameteric Cubic Convolution, Computer Visual Graphic Image 
Processing, Vol. 23, pp 258-272, 1983) proposes a cubic convolution interpolation 
technique in which a is used as a tuning parameter. According to this technique, optimized 
a is obtained by inferring the relationship between a and the frequency characteristic of 
original image data, and then the cubic convolution interpolation is implemented. 
However, according to this method, the optimized a is obtained by inferring the 
relationship between a and the overall frequency characteristic of one frame image to be 
processed. Thus, compared to the previous technique in which a is set to a fixed value, a 
consideration into the frequency characteristic of image data can be rather sufficiently 
taken. However, since a is inferred using the overall frequency characteristic of one frame 
image, in the case where the image has various spatial frequencies, the quantity of 
information loss associated with a change in the spatial frequency components becomes 
relatively increased, resulting in deterioration in the quality of scaled image data. 

SUMMARY OF THE INVENTION 

Accordingly, it is an object of the present invention to provide a cubic convolution 
interpolating apparatus and method, which can minimize the quantity of information loss in 
a scaled or resampled image signal. 

It is another object of the present invention to provide a cubic convolution 
interpolating apparatus and method, for performing interpolation by optimizing a parameter 
which determines the interpolation coefficients according to the local property of an image 
signal. 



Additional objects and advantages of the invention will be set forth in part in the 
description which follows, and, in part, will be obvious from the description, or may be 
learned by practice of the invention. 

Accordingly, to achieve the above and other objects of the present invention, there 
5 is provided a cubic convolution interpolating apparatus including an image signal divider 
dividing an image signal into a plurality of subb locks, and a block generating parameters 
which determine cubic convolution interpolation coefficients in units of subblocks, and 
performing cubic convolution interpolation. 

The cubic convolution interpolating block includes a forward scaling processor 
10 sampling a cubic convolution interpolated continuous function of original image data 

transmitted from the image signal divider using a first scaling factor and scaling the original 

O image data, a backward scaling processor sampling a backward cubic convolution 

ip 

m interpolated continuous function of the scaled data output from the forward scaling 

processor using a second scaling factor and restoring the scaled data into the original image 
:§5 data, and a parameter optimizer optimizing parameters using the original image data and 
*p the data restored in the original image data output from the backward scaling processor, 
q and transferring the optimized parameter to the forward scaling processor and the backward 

scaling processor, respectively. 
*0 To achieve the above and other objects of present invention, there is provided a 

Q£) cubic convolution interpolating method including dividing an image signal into a plurality 
of subblocks, and generating parameters which determine cubic convolution interpolation 
coefficients in units of subblocks, and performing cubic convolution interpolation. 

The cubic convolution interpolating method includes sampling a cubic convolution 
interpolated continuous function of original image data using a first scaling factor and 
25 forward scaling the original image data, sampling a backward cubic convolution 
interpolated continuous function of the scaled data obtained in the forward scaling 
processing step using a second scaling factor and restoring the scaled data backward into 
the original image data, determining and optimizing a parameter which determines the 
cubic convolution interpolation coefficient using the original image data and the data 
30 restored into the original image data by the backward scaling processing step, and 

supplying the optimized parameter to be used in forward scaling and backward scaling. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

These and other objects and advantages of the present invention will become more 
apparent and more readily appreciated from the following description of the preferred 
embodiments, taken in conjunction with the accompanying drawings of which: 
5 FIG. 1 is a block diagram of a cubic convolution interpolating apparatus according 

to the present invention; 

FIG. 2 is a detailed block diagram of a parameter optimizer shown in FIG. 1; 

FIG. 3 is an operational flow diagram of a cubic convolution interpolation method 
according to an embodiment of the present invention; and 
10 FIG. 4 is an operational flow diagram of a cubic convolution interpolation method 

according to another embodiment of the present invention. 

O 

•.f% 

j J DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[Z Reference will now be made in detail to the preferred embodiments of the present 

*g invention, examples of which are illustrated in the accompanying drawings, wherein like 
=£5 reference numerals refer to like elements throughout. 

FIG. 1 is a block diagram of a cubic convolution interpolator according to the 

JJt present invention. The cubic convolution interpolator includes an image signal divider 101, 

i y 

*S a forward scaling processor 102, a backward scaling processor 106 and a parameter 

□ 

optimizer 111. 

20 The forward scaling processor 102 includes a forward cubic convolution 

interpolated continuous function detector 103 and a sampler 105. The backward scaling 
processor 106 includes a backward cubic convolution interpolated continuous function 
detector 107 and a sampler 109. 

The image signal divider 101 divides an input 1-frame image signal into nx n 

25 subblocks. In order to optimize a (a parameter which determines an interpolation 

coefficient) into units of subblocks, the image signal divider 101 sequentially transfers 
pixel-unit image data to a next stage unit, which is the forward cubic convolution 
interpolated continuous function detector 103. The pixel-unit image data is sampled data of 
an original video image. 
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The forward cubic convolution interpolated continuous function detector 103 detects 
a corresponding continuous function using the preset parameter a arid the Equation 

(4) when the original image sample data y ^ ^ is applied thereto from the image signal 

divider 101. The preset parameter a is an initial value, e.g., - 1 or - V2, at an initial stage 
of interpolation, and is a replaced value when the initial value is replaced by interpolation. 
The sampler 105 scales the forward cubic convolution interpolated continuous 

function f/\ using a scaling factor 6, as represented below: 



f(yn)=f(x) 



...(5) 



wherein n is an integer, and the sampler 105 outputs scaled data J^y^ > which can be an 
enlarged or reduced image signal according to the scaling factor 8. The procedure for 
obtaining the scaled data f^yyj^ ' w hich is scaled from the cubic convolution interpolated 

continuous function y^ x ) f° r the original sample data ) » * s referred to as forward 

scaling. 

According to the present invention, in changing an original image into an enlarged 
or reduced image having a desired level of resolution using the forward scaling (in order to 
minimize the quantity of lost information in consideration of the local property of an image 
signal), backward scaling and optimization of the parameter a are performed as follows. 

The backward cubic convolution interpolated continuous function detector 107 

detects a cubic convolution interpolated continuous function g(^y^ using Equation (6) 
when the scaled data J^yy^ x% applied thereto: 



*0 



! 



g(y) = f(y n -i){ a (t 3 - 2t2 + 0} - (6) 
+ /0O{*(' 3 -' 2 )+(2r 3 -3r 2 + i)} 

+ fiy n+i ){a{-t' + 2? 2 - 0+ (~2t 3 + 3t 2 )} 

+ /(^ +2 ){«(-^ + ^ 2 )} 
wherein t is an ambient sampling point, like s in Example (4), and y is an interpolation 

point at which interpolation based on the scaled data f^yyj^ ls performed. 

The sampler 109 obtains ^ x ^ , which is data restored into the original image data 
^ using a scaling factor 1/5, when the cubic convolution interpolated continuous 



function g(y^ IS applied thereto, as represented below: 



= £0) 



■(7) 



t = x k -y„ 



I sj wherein is a sampling point of the data to be obtained, and is a point given by the 

X k Sri 



scaled data f^yy^ * Unlike in the forward scaling in which 8 is used as the scaling factor 

10 for enlarging image data, in the backward scaling, 1/8 is used as the scaling factor in order 
to reduce the image data. 

The parameter optimizer 111 obtains an optimized parameter a adapted to minimize 

the quantity of lost information when the original image sample data f ( x and backward 

J \ x k) 

scaled data ^ x ^ are applied thereto. To this end, the parameter optimizer 111, as 

15 shown in FIG, 2, is constituted by a parameter variation detector 201, a parameter detector 
203, a parameter replacement determination unit 205 and a parameter replacement & 
supply unit 207. 
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When the original image sample data y( x ) anc * backward scaled data ^ x ^ are 
applied to the parameter variation detector 201, the parameter variation detector 201 detects 
a parameter variation ^ a as represented by: 

m, •••<8) 

A« = -, — («) 

wherein r| is a nonnegative value, and the parameter a increases along the direction of the 
negative gradient gj£ . Also, the quantity of lost information of one subblock, that is, 

E(cc) is obtained using the original image sample data y^ x ^ and backward scaled data 

g(x ) as re P resente( i by: 

-.(9) 



£(«)=X{/(**)-s(**)} 2 



and thus can be given by: 



dE rn - ( )2 ...(10) 

-£-(«)= I *{/(**)-*<**)} 



= I 2{f(x k )-g(x k )}{£f{x k )--kg(x k )} 
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wherein, since 



/(**) 



is a fixed pixel value for the original image data, g 

da 



f 



and $ can be obtained using Equations (6) and (7), as represented by: 



...(ii) 



+ /(y«iX-t J +2/ 2 -/) 

fa 



+ /(U(-' 3 ^)) 



In Equation (11), Q „ can be written by: 



<9cc 

+ /(^){(^ 3 -^ 2 )} 

Then, the parameter variation detector 201 transfers the detected parameter 
variation ^ a to the parameter detector 203 . The parameter detector 203 detects an 
updated parameter a*, which is a value when the quantity of lost information, E(a), is 
minimum, as represented by: 

or* = a + ka •••< 13 ) 

and the detected updated parameter a* is then transferred to the parameter replacement 
determination unit 205. When the updated parameter a* is applied, the parameter 
replacement determination unit 205 determines whether the updated parameter a* is to be 
replaced or not using the quantity of lost information E(a) transferred from the parameter 
variation detector 201. 

The replacement or non-replacement of the updated parameter a*, which is 
determined by the parameter replacement determination unit 205, may be determined in 
units of frames or subblocks. 

In the case of frame unit replacement, the replacement with the updated parameter 
a* is determined by: 




wherein is the total quantity of lost information of a previous frame and is 

V/ V/ 

the total quantity of lost information of a current frame. Here, the total quantity of lost 
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information is the sum of the quantities of lost information for the respective subblocks. As 
given by Equation (14), if a value obtained by subtracting the total quantity of lost 
information of a current frame from the total quantity of lost information of a previous 
frame (the value divided by the total quantity of lost information of a current frame) is 
greater than a threshold , the parameter replacement determination unit 205 determines 

O y 

that the parameter a is to be replaced with the updated parameter a obtained in the current 
frame in units of subblocks. Here, as the threshold is smaller, finer optimization is 

O y 

performed with respect to the parameter a. 

However, if the operation result of Equation (14) is not greater than the threshold 
, the parameter replacement determination unit 205 determines that the parameter a is 

o y 

not to be replaced with the updated parameter a* obtained in the current frame in units of 
subblocks. 

In the case of subblock unit replacement, the parameter replacement determination 
unit 205 determines whether replacement with the updated parameter a* is to be performed, 
as represented by: 




wherein is the quantity of lost information of the /th subblock in a previous frame 

and is the quantity of lost information of the /th subblock in a current frame. As 

given by Equation (15), if a value obtained by subtracting the quantity of lost information 
of the corresponding subblock in a current frame from the quantity of lost information of 
the corresponding subblock in a previous frame divided by the quantity of lost information 
of the corresponding subblock in a current frame is greater than a threshold , the 

O y 

parameter replacement determination unit 205 determines that the parameter a is to be 
replaced with the updated parameter a*. However, if the result of Equation (15) is not 
greater than the threshold , the parameter replacement determination unit 205 determines 

O y 

that the parameter a is not to be replaced with the updated parameter a*. 
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The parameter replacement and supply unit 207 replaces the parameter a with the 
updated parameter a* according to the determination made by the parameter replacement 
determination unit 205, and then transfers the replaced updated parameter a* to the forward 
cubic convolution interpolated continuous function detector 103 and the backward cubic 
5 convolution interpolated continuous function detector 107, respectively. The replacement 
of the parameter a with the updated parameter a* may be processed in units of either 
frames or subblocks according to the implementation type of the parameter replacement 
determination unit 205. In other words, if the frame unit replacement is determined, the 
parameter replacement and supply unit 207 replaces the parameter with a new one in units 
10 of frames. If subblock unit replacement is determined, the parameter replacement and 

supply unit 207 replaces the parameter with new one in units of subblocks. 
13 Replacement of the parameter a with the updated parameter a* and supply of the 

ip replaced parameter to the forward cubic convolution interpolated continuous function 
^ detector 103 and the backward cubic convolution interpolated continuous function detector 
i|5 107 are iteratively performed until it is determined by the parameter replacement 
=p determination unit 205 that further parameter replacement is not necessary. 

FIG. 3 is an operational flow diagram of a cubic convolution interpolating method 

s - ! 

1 j! according to an embodiment of the present invention, in which the parameter a is replaced 
*0 in units of frames. 

I 5 

p) In operation 301, a one-frame image to be scaled or resampled is divided into T 

subblocks. In operation 302, the forward cubic convolution interpolated continuous 

function f° r original sample data ) * s detected by Equation (5). Then, in 

operation 303, scaled data J^yy^ * s detected using the detected continuous function 

y^ x ) anc * a scaling factor 6. 
25 In operation 304 a backward cubic convolution interpolated continuous function 

g(y) f° r the scaled data J(yyi) is detected by Equation (6). In operation 305, 
backward scaled restored data g( x ^) ls detected using the backward cubic convolution 
interpolated continuous function g(^y) anc * a scaling factor 1/6. 

12 



# • 

In operation 306 the quantity of lost information E(a) is obtained by Equation (9) 
using the original image sample data ^ and the restored data ^ x ^ . In operation 

307 the parameter variation ^ a of the corresponding subblock is obtained by Equation 
(8). In operation 308 the parameter replacement operation is performed on the obtained 
parameter variation ^ a and the currently set parameter a as represented by Equation (13) 
to obtain an updated parameter a* of the corresponding subblock. 

In operation 309, it is checked whether / equals T, wherein / is a subblock on which 
current cubic convolution interpolation is performed among subblocks contained in one 
frame. If i is equal to T, it is determined that cubic convolution interpolation has been 
performed on all subblocks in the corresponding frame. If i is not equal to T, it is 
determined that cubic convolution interpolation has not been performed on all subblocks in 
the corresponding frame. Thus, in operation 310, / is incremented by 1 (i = i + l) for 
performing cubic convolution interpolation for a subsequent subblock, and then the routine 
is returned to operation 302 for iteration. 

However, if / is equal to T, that is, if cubic convolution interpolation has been 
performed on all subblocks of the corresponding frame, it is determined in operation 311 
whether the parameter is to be replaced or not. The determination is made in the same 
manner with the case of frame unit replacement determined by the parameter replacement 
determination unit 205. 

If it is determined in operation 312 that replacement is necessary, the routine 
proceeds to operation 313 to replace the parameter of each subblock with the updated 
parameter a* and then supply the same to the forward cubic convolution interpolated 
continuous function detector 103 and the backward cubic convolution interpolated 
continuous function detector 107, respectively. In operation 314, i is set to 1 to iteratively 
perform forward and backward convolution interpolation in units of subblocks of the 
corresponding frame. However, if it is determined in operation 312 that replacement is not 
necessary, cubic convolution interpolation associated with parameter replacement is 
terminated. 



13 



# • 

FIG. 4 is an operational flow diagram of a cubic convolution interpolating method 
according to another embodiment of the present invention, in which the parameter a is 
replaced in units of subb locks. 

Since the operations 401-408 are the same as the operations 301-308, an explanation 
- 5 thereof will not be given. If the updated parameter a* is obtained, it is determined by the 
parameter replacement determination unit 205 in step 409 whether the parameter is to be 
replaced or not. 

If it is determined in operation 409 that replacement is necessary, the routine 
proceeds to operation 411 to replace the parameter a with the updated parameter a* to then 
10 supply the same to the forward cubic convolution interpolated continuous function detector 

103 and the backward cubic convolution interpolated continuous function detector 107, 
□ respectively. In operation 412, it is checked whether or not / is equal to T, If / is not equal 
jiri to T, the routine proceeds to operation 413 to increment / by one and then returns to 
j™ operation 402 to perform cubic convolution interpolation for a subsequent subblock. * 

*£5 However, if it is determined in operation 412 that / is equal to T, i is set to 1 in 

IB 

,E operation 415 to then proceed to operation 402. This routine is iteratively performed until 
~ the parameter converges to a predetermined threshold value, which means that the 
j^j parameter is not replaced with a new one. 

\Q If it is determined in operation 410 that replacement is not necessary, it is checked 

lZp in operation 416 whether i is equal to T. If i is not equal to T, the routine proceeds to 

operation 417 to increment i by 1 and return to operation 402. However, if it is checked 
in operation 416 that / is equal to T, the routine proceeds to operation 418 to check whether 
or not at least one parameter for the corresponding one frame image has been replaced or 
not. If at least one parameter has been replaced, the routine proceeds to operation 415 to 

25 set / to 1 and then returns to operation 402 to iteratively perform the above procedure until 
the parameter converges to the predetermined threshold value. 

According to the present invention, even if a one-frame image includes various 
spatial frequency components, the quantity of lost information due to a change in the local 
property of the spatial frequencies can be minimized, thereby improving the quality of 

30 scaled image data. 
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Although a few preferred embodiments of the present invention have been shown 
and described, it will be appreciated by those skilled in the art that changes may be made 
these embodiments without departing from the principle and spirit of the invention, the 
scope of which is defined in the appended claims and their equivalents. 
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